Systems and methods for increasing image fidelity

ABSTRACT

Image captured through a non-rectilinear lens may exhibit distortions. The distortions may be reduced by warping the image. However, warping the image may degrade the fidelity of the image. The warped image may be enhanced to increase the fidelity of the image. The enhancement may be applied to the portions of the image that were degraded from the warping.

FIELD

This disclosure relates to increasing image fidelity using non-uniformenhancement of warped image.

BACKGROUND

An image captured through a non-rectilinear may be distorted. Reducingdistortion in the image through warping may reduce the fidelity of theimage.

SUMMARY

This disclosure relates to increasing image fidelity. Visual informationand/or other information may be obtained. The visual information maydefine visual content of an image. The visual content may depict a scenewith a distortion based on capture of the visual content through anon-rectilinear lens such that a straight line within the scene isdepicted as a curved line within the visual content. Rectilinear visualcontent may be generated based on non-uniform warping of the visualcontent. The non-uniform warping of the visual content may includestraightening of the curved line within the visual content. Thenon-uniform warping of the visual content may include different warpingapplied to different portions of the visual content such that therectilinear visual content has non-uniform fidelity. A first portion ofthe rectilinear visual content may have first fidelity and a secondportion of the rectilinear visual content may have second fidelity lowerthan the first fidelity.

Higher-fidelity visual content may be generated based on non-uniformenhancement of the rectilinear visual content. The non-uniformenhancement of the rectilinear visual content may be performed based onthe non-uniform warping of the visual content and/or other information.The non-uniform enhancement of the rectilinear visual content mayincrease fidelity uniformity of the higher-fidelity visual content. Thefidelity uniformity of the higher-fidelity visual content may beincreased such that difference between the first fidelity of the firstportion of the higher-fidelity visual content and the second fidelity ofthe second portion of the higher-fidelity visual content is reduced.

A system that increases image fidelity may include one or moreelectronic storages, one or more processors, and/or other components. Anelectronic storage may store visual information, information relating tovisual content, information relating to rectilinear visual content,information relating to higher-fidelity visual content, informationrelating to distortion, information relating to a non-rectilinear lens,information relating to capture of visual content, information relatingto non-uniform warping, information relating to non-uniform enhancement,and/or other information. In some implementations, the system mayinclude one or more optical elements, one or more image sensors, and/orother components.

One or more components of the system may be carried by a housing, suchas a housing of an image capture device. For example, the opticalelement(s) and/or the image sensor(s) of the system may be carried bythe housing of an image capture device. The housing may carry othercomponents, such as the processor(s) and/or the electronic storage. Insome implementations, the higher-fidelity visual content may begenerated before encoding of the image by the image capture device.

The processor(s) may be configured by machine-readable instructions.Executing the machine-readable instructions may cause the processor(s)to facilitate increasing image fidelity. The machine-readableinstructions may include one or more computer program components. Thecomputer program components may include one or more of a visualinformation component, a non-uniform warming component, a non-uniformenhancement component, and/or other computer program components.

The visual information component may be configured to obtain visualinformation and/or other information. The visual information may definevisual content of an image. The visual content may depict a scene. Thescene may be depicted with a distortion based on capture of the visualcontent through a non-rectilinear lens. Capture of the visual contentthrough the non-rectilinear lens may cause a straight line within thescene to be depicted as a curved line within the visual content.

In some implementations, the distortion may include a barrel distortionand the non-rectilinear lens may include a fisheye lens.

The non-uniform warming component may be configured to generaterectilinear visual content. The rectilinear visual content may begenerated based on non-uniform warping of the visual content. Thenon-uniform warping of the visual content may include straightening ofthe curved line within the visual content. The non-uniform warping ofthe visual content may include different warping applied to differentportions of the visual content. Application of different warping todifferent portions of the visual content may result in the rectilinearvisual content having non-uniform fidelity. A first portion of therectilinear visual content may have first fidelity and a second portionof the rectilinear visual content may have second fidelity lower thanthe first fidelity.

In some implementations, generation of the rectilinear visual contentmay include cropping of one or more outer portions of the visualcontent.

In some implementations, the non-uniform warping of the visual contentincluding the different warping applied to the different portions of thevisual content may include different strengths of warping being appliedto the different portions of the visual content.

In some implementations, the non-uniform warping of the visual contentincluding the different warping applied to the different portions of thevisual content may further include different directions of warping beingapplied to the different portions of the visual content.

The non-uniform enhancement component may be configured to generatehigher-fidelity visual content. The higher-fidelity visual content maybe generated based on non-uniform enhancement of the rectilinear visualcontent. The non-uniform enhancement of the rectilinear visual contentmay be performed based on the non-uniform warping of the visual contentand/or other information. The non-uniform enhancement of the rectilinearvisual content may increase fidelity uniformity of the higher-fidelityvisual content. The fidelity uniformity of the higher-fidelity visualcontent may be increased such that difference between the first fidelityof the first portion of the higher-fidelity visual content and thesecond fidelity of the second portion of the higher-fidelity visualcontent is reduced.

In some implementations, the non-uniform enhancement of the rectilinearvisual content may include application of non-uniform super-resolutionto the rectilinear visual content. In some implementations, thenon-uniform enhancement of the rectilinear visual content may includeapplication of non-uniform sharpening to the rectilinear visual content.

In some implementations, the non-uniform enhancement of the rectilinearvisual content being performed based on the non-uniform warping of thevisual content may include different strengths of enhancement beingapplied to the different portions of the rectilinear visual contentbased on the different strengths of warping applied to the differentportions of the visual content and/or other information.

In some implementations, the non-uniform enhancement of the rectilinearvisual content being performed based on the non-uniform warping of thevisual content may further include different types of enhancement beingapplied to the different portions of the rectilinear visual contentbased on the different directions of warping applied to the differentportions of the visual content and/or other information.

These and other objects, features, and characteristics of the systemand/or method disclosed herein, as well as the methods of operation andfunctions of the related elements of structure and the combination ofparts and economies of manufacture, will become more apparent uponconsideration of the following description and the appended claims withreference to the accompanying drawings, all of which form a part of thisspecification, wherein like reference numerals designate correspondingparts in the various figures. It is to be expressly understood, however,that the drawings are for the purpose of illustration and descriptiononly and are not intended as a definition of the limits of theinvention. As used in the specification and in the claims, the singularform of “a,” “an,” and “the” include plural referents unless the contextclearly dictates otherwise.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an example system for increasing image fidelity.

FIG. 2 illustrates an example method for increasing image fidelity.

FIG. 3 illustrates an example image capture device.

FIG. 4 illustrates an example image with barrel distortion.

FIG. 5 illustrates an example warping of the image shown in FIG. 4 .

FIGS. 6A and 6B illustrate example portions of the warped image shown inFIG. 5 .

FIG. 7A illustrates an example portion of an image captured using anon-rectilinear lens.

FIG. 7B illustrates an example enhancement of the image portion shown inFIG. 7A.

DETAILED DESCRIPTION

FIG. 1 illustrates a system 10 for stabilizing videos. The system 10 mayinclude one or more of a processor 11, an interface 12 (e.g., bus,wireless interface), an electronic storage 13, and/or other components.In some implementations, the system 10 may include one or more opticalelements, one or more image sensors, and/or other components. Visualinformation and/or other information may be obtained by the processor11. The visual information may define visual content of an image. Thevisual content may depict a scene with a distortion based on capture ofthe visual content through a non-rectilinear lens such that a straightline within the scene is depicted as a curved line within the visualcontent. Rectilinear visual content may be generated by the processor 11based on non-uniform warping of the visual content. The non-uniformwarping of the visual content may include straightening of the curvedline within the visual content. The non-uniform warping of the visualcontent may include different warping applied to different portions ofthe visual content such that the rectilinear visual content hasnon-uniform fidelity. A first portion of the rectilinear visual contentmay have first fidelity and a second portion of the rectilinear visualcontent may have second fidelity lower than the first fidelity.

Higher-fidelity visual content may be generated by the processor 11based on non-uniform enhancement of the rectilinear visual content. Thenon-uniform enhancement of the rectilinear visual content may beperformed based on the non-uniform warping of the visual content and/orother information. The non-uniform enhancement of the rectilinear visualcontent may increase fidelity uniformity of the higher-fidelity visualcontent. The fidelity uniformity of the higher-fidelity visual contentmay be increased such that difference between the first fidelity of thefirst portion of the higher-fidelity visual content and the secondfidelity of the second portion of the higher-fidelity visual content isreduced.

The electronic storage 13 may be configured to include electronicstorage medium that electronically stores information. The electronicstorage 13 may store software algorithms, information determined by theprocessor 11, information received remotely, and/or other informationthat enables the system 10 to function properly. For example, theelectronic storage 13 may store visual information, information relatingto visual content, information relating to rectilinear visual content,information relating to higher-fidelity visual content, informationrelating to distortion, information relating to a non-rectilinear lens,information relating to capture of visual content, information relatingto non-uniform warping, information relating to non-uniform enhancement,and/or other information.

Visual content may refer to content of image(s) (e.g., single image,burst images, video frame(s), and/or video(s)) that may be consumedvisually. For example, visual content may be included within one or moreimages and/or one or more video frames of a video. The video frame(s)may define/contain the visual content of the video. That is, video mayinclude video frame(s) that define/contain the visual content of thevideo. Video frame(s) may define/contain visual content viewable as afunction of progress through the progress length (duration, number offrames) of the video. A video frame may include an image of the videocontent at a moment within the progress length of the video. As usedherein, term video frame may be used to refer to one or more of an imageframe, frame of pixels, encoded frame (e.g., I-frame, P-frame, B-frame),and/or other types of video frame. Visual content may be generated basedon light received within a field of view of a single image sensor orwithin fields of view of multiple image sensors.

Visual content (of image(s), of video frame(s), of video(s)) with afield of view may be captured by an image capture device. A field ofview of visual content may define a field of view of a scene capturedwithin the visual content. A field of view of visual content may referto an extent of a scene captured and/or viewable within the visualcontent. A field of view of visual content may refer to a part of ascene from which light is received for generation of the visual content.For example, an image may include a wide field of view image, such as apanoramic image or a spherical image, and the field of view may of theimage may include a wide field of view (e.g., greater than 120 degrees,360 degrees). Other fields of view are contemplated.

Visual content may be stored in one or more formats and/or one or morecontainers. A format may refer to one or more ways in which theinformation defining visual content is arranged/laid out (e.g., fileformat). A container may refer to one or more ways in which informationdefining visual content is arranged/laid out in association with otherinformation (e.g., wrapper format). Information defining visual content(visual information) may be stored within a single file or multiplefiles. For example, visual information defining an image or video framesof a video may be stored within a single file (e.g., image file, videofile), multiple files (e.g., multiple image files, multiple videofiles), a combination of different files, and/or other files.

The system 10 may be remote from the image capture device or local tothe image capture device. One or more portions of the image capturedevice may be remote from or a part of the system 10. One or moreportions of the system 10 may be remote from or a part of the imagecapture device. For example, one or more components of the system 10 maybe carried by a housing, such as a housing of an image capture device.For instance, optical element(s) and/or image sensor(s) of the system 10may be carried by the housing of the image capture device. The housingmay carry other components, such as the processor 11 and/or theelectronic storage 13. References to a housing of an image capturedevice may refer to the image capture device, and vice versa.

An image capture device may refer to a device captures visual content.An image capture device may capture visual content in form of images,videos, and/or other forms. An image capture device may refer to adevice for recording visual information in the form of images, videos,and/or other media. An image capture device may be a standalone device(e.g., camera, action camera, image sensor) or may be part of anotherdevice (e.g., part of a smartphone, tablet). FIG. 3 illustrates anexample image capture device 302. Visual content may be captured by theimage capture device 302. The image capture device 302 may include ahousing 312. The housing 312 may refer a device (e.g., casing, shell)that covers, protects, and/or supports one or more components of theimage capture device 302. The housing 312 may include a single-piecehousing or a multi-piece housing. The housing 312 may carry (be attachedto, support, hold, and/or otherwise carry) one or more of an opticalelement 304, an image sensor 306, an electronic storage 308, a processor310, and/or other components.

One or more components of the image capture device 302 may be the sameas, be similar to, and/or correspond to one or more components of thesystem 10. For example, the electronic storage 308 may be the same as,be similar to, and/or correspond to the electronic storage 13. Theprocessor 310 may be the same as, be similar to, and/or correspond tothe processor 11. The image capture device 302 may include othercomponents not shown in FIG. 3 , such as one or more sound sensors. Thesound sensor(s) may be used by the image capture device 302 to captureaudio content. The image capture device 302 may not include one or morecomponents shown in FIG. 3 . Other configurations of image capturedevices are contemplated.

The optical element 304 may include instrument(s), tool(s), and/ormedium that acts upon light passing through theinstrument(s)/tool(s)/medium. For example, the optical element 304 mayinclude one or more of lens, mirror, prism, and/or other opticalelements. The optical element 304 may affect direction, deviation,and/or path of the light passing through the optical element 304. Theoptical element 304 may have a field of view 305. The optical element304 may be configured to guide light within the field of view 305 to theimage sensor 306.

For example, the optical element 304 may include a non-rectilinear lens.A non-rectilinear lens may include a curvilinear lens. A non-rectilinearlens may refer to a lens that produces images where straight features ina scene appear as non-straight lines (e.g., curved lines). Anon-rectilinear lens may cause visual content captured through the lensto include distortion within one or more portions of the visual content.For example, the optical element 304 may include a fisheye lens, whichmay cause the visual content captured through the optical element 304 toinclude barrel distortion and/or other distortion. Other types ofoptical element/lens and other types of distortion within the visualcontent are contemplated.

The field of view 305 may include the field of view of a scene that iswithin the field of view of the optical element 304 and/or the field ofview of the scene that is delivered to the image sensor 306. Forexample, the optical element 304 may guide light within its field ofview to the image sensor 306 or may guide light within a portion of itsfield of view to the image sensor 306. The field of view of 305 of theoptical element 304 may refer to the extent of the observable world thatis seen through the optical element 304. The field of view 305 of theoptical element 304 may include one or more angles (e.g., verticalangle, horizontal angle, diagonal angle) at which light is received andpassed on by the optical element 304 to the image sensor 306. In someimplementations, the field of view 305 may be greater than 180-degrees.In some implementations, the field of view 305 may be less than180-degrees. In some implementations, the field of view 305 may be equalto 180-degrees.

In some implementations, the image capture device 302 may includemultiple optical elements. For example, the image capture device 302 mayinclude multiple optical elements that are arranged on the housing 312to capture spherical images/videos (guide light within spherical fieldof view to one or more images sensors). For instance, the image capturedevice 302 may include two optical elements positioned on opposing sidesof the housing 312. The fields of views of the optical elements mayoverlap and enable capture of spherical images and/or spherical videos.

The image sensor 306 may include sensor(s) that converts received lightinto output signals. The output signals may include electrical signals.The image sensor 306 may generate output signals conveying informationthat defines visual content of one or more images. For example, theimage sensor 306 may include one or more of a charge-coupled devicesensor, an active pixel sensor, a complementary metal-oxidesemiconductor sensor, an N-type metal-oxide-semiconductor sensor, and/orother image sensors.

The image sensor 306 may be configured generate output signals conveyinginformation that defines visual content of one or more images. The imagesensor 306 may be configured to generate a visual output signal based onlight that becomes incident thereon during a capture duration and/orother information. The visual output signal may convey visualinformation that defines visual content having the field of view. Theoptical element 304 may be configured to guide light within the field ofview 305 to the image sensor 306, and the image sensor 306 may beconfigured to generate visual output signals conveying visualinformation based on light that becomes incident thereon via the opticalelement 304.

The visual information may define visual content by includinginformation that defines one or more content, qualities, attributes,features, and/or other aspects of the visual content. For example, thevisual information may define visual content of an image by includinginformation that makes up the content of the image, and/or informationthat is used to determine the content of the image. For instance, thevisual information may include information that makes up and/or is usedto determine the arrangement of pixels, characteristics of pixels,values of pixels, and/or other aspects of pixels that define visualcontent of the image. For example, the visual information may includeinformation that makes up and/or is used to determine pixels of theimage. Other types of visual information are contemplated.

Capture of visual content by the image sensor 306 may include conversionof light received by the image sensor 306 into output signals/visualinformation defining visual content. Capturing visual content mayinclude recording, storing, and/or otherwise capturing the visualcontent for use in generating video content (e.g., content of videoframes). For example, during a capture duration, the visual outputsignal generated by the image sensor 306 and/or the visual informationconveyed by the visual output signal may be used to record, store,and/or otherwise capture the visual content for use in generating videocontent. Video content may include other content captured by the imagecapture device 302, such as audio content captured by the image capturedevice.

In some implementations, the image capture device 302 may includemultiple image sensors. For example, the image capture device 302 mayinclude multiple image sensors carried by the housing 312 to capturespherical images/videos based on light guided thereto by multipleoptical elements. For instance, the image capture device 302 may includetwo image sensors configured to receive light from two optical elementspositioned on opposing sides of the housing 312. The fields of views ofthe optical elements may overlap and enable capture of spherical imagesand/or spherical videos.

The processor 310 may include one or more processors (logic circuitry)that provide information processing capabilities in the image capturedevice 302. The processor 310 may provide one or more computingfunctions for the image capture device 302. The processor 310 mayoperate/send command signals to one or more components of the imagecapture device 302 to operate the image capture device 302. For example,the processor 310 may facilitate operation of the image capture device302 in capturing image(s) and/or video(s), facilitate operation of theoptical element 304 (e.g., change how light is guided by the opticalelement 304), and/or facilitate operation of the image sensor 306 (e.g.,change how the received light is converted into information that definesimages/videos and/or how the images/videos are post-processed aftercapture).

The processor 310 may obtain information from the image sensor 306,and/or facilitate transfer of information from the image sensor 306 toanother device/component. The processor 310 may be remote from theprocessor 11 or local to the processor 11. One or more portions of theprocessor 310 may be part of the processor 11 and/or one or moreportions of the processor 10 may be part of the processor 310. Theprocessor 310 may include and/or perform one or more functionalities ofthe processor 11 shown in FIG. 1 .

For example, the processor 310 may obtain visual information definingvisual content captured through the optical element 304. The visualcontent may depict a scene observed within the field of view 305 by theimage sensor 306. The visual content captured by the image sensor 306may depict the scene with one or more distortions based on the captureof the visual content through the optical element 304, with the opticalelement 304 include one or more non-rectilinear lens. The distortion(s)may cause a straight line within the scene to be depicted as a curvedline within the visual content.

The processor 310 may warp the visual content to generate rectilinearvisual content. The visual content may be warped non-uniformly tostraighten curved portions of the visual content. For portions with lesscurvature (due to the non-rectilinear lens), less warping may beapplied. For portions with greater curvature, greater warping may beapplied. For example, the visual content may have been captured througha fisheye lens, and the processor 310 may unwrap/stretch the visualcontent to make the visual content look as if it were captured throughrectilinear lens. The rectilinear visual content may have non-uniformfidelity due to the non-uniform warping applied to the visual content.Portions of the visual content that was warped more (e.g., morestretching applied) may have lower fidelity than Portions of the visualcontent that was warped less/not warped (e.g., less stretching applied,no stretching applied, squeezing applied). For example, fisheye visualcontent may be warped more in the corners than in the center to generatethe rectilinear visual content, and the corners of the rectilinearvisual content may have less fidelity than the center of the rectilinearvisual content.

The processor 310 may increase the uniformity of the fidelity throughoutthe rectilinear visual content to generate higher-fidelity visualcontent. The processor 310 may increase the fidelity throughout therectilinear visual content by non-uniformly enhancing the rectilinearvisual content. The processor 310 may apply different amount and/or typeof enhancement to different portions of the rectilinear visual contentbased on the non-uniform warping of the visual content to generate thoseportions. That is, the amount and/or the type of enhancement applied toa portion of the rectilinear visual content may depend on how the visualcontent was warp to generate that portion.

For example, the loss/reduction in fidelity of a portion of therectilinear visual content may depend on the strength and/or thedirection in which the visual content was warped to generate theportion. The processor 310 may adjust the strength and/or type ofenhancement applied to the portion based on the strength and/or thedirection in which the visual content was warped to generate theportion. The processor 310 may pick the strength and/or type ofenhancement applied to the portion to restore (completely restore,partially restore) the fidelity reduction caused by the warping. Forinstance, the processor 310 may pick the strength and/or type ofenhancement applied to the portion to repair the damage done to theportion of the image via the warping of the portion. The higher-fidelityvisual content may be generated by the processor 310 before and/or afterencoding of the image by the image capture device. For example, theprocessor 310 may generate the higher-fidelity visual content to replacethe visual content when encoding the image. The processor 310 maygenerate the higher-fidelity visual content to encode an additionalimage with higher fidelity (e.g., encode the original image and thehigher-fidelity image).

Referring back to FIG. 1 , the processor 11 may be configured to provideinformation processing capabilities in the system 10. As such, theprocessor 11 may comprise one or more of a digital processor, an analogprocessor, a digital circuit designed to process information, a centralprocessing unit, a graphics processing unit, a microcontroller, ananalog circuit designed to process information, a state machine, and/orother mechanisms for electronically processing information. Theprocessor 11 may be configured to execute one or more machine-readableinstructions 100 to facilitate increasing image fidelity. Themachine-readable instructions 100 may include one or more computerprogram components. The machine-readable instructions 100 may includeone or more of a visual information component 102, a non-uniform warmingcomponent 104, a non-uniform enhancement component 106, and/or othercomputer program components.

The visual information component 102 may be configured to obtain visualinformation and/or other information. Obtaining visual information mayinclude one or more of accessing, acquiring, analyzing, determining,examining, generating, identifying, loading, locating, opening,receiving, retrieving, reviewing, selecting, storing, and/or otherwiseobtaining the visual information. The visual information component 102may obtain visual information from one or more locations. For example,the visual information component 102 may obtain visual information froma storage location, such as the electronic storage 13, electronicstorage of information and/or signals generated by one or more sensors,electronic storage of a device accessible via a network, and/or otherlocations. The visual information component 102 may obtain visualinformation from one or more hardware components (e.g., an image sensor)and/or one or more software components (e.g., software running on acomputing device).

In some implementations, the visual information component 102 may obtainvisual information based on user interaction with a userinterface/application (e.g., image/video editing application,image/video viewer application), and/or other information. For example,a user interface/application may provide option(s) for a user to selectvisual content in which fidelity is to be increased. The visualinformation defining the visual content may be obtained based on theuser's selection of the visual content/image through the userinterface/video application. Other selections of visual content/imagefor retrieval of visual information are contemplated.

The visual information may define visual content of an image. The visualcontent of the image may depict a scene. The visual content may depict ascene that is captured through an optical element (e.g., lens) of animage capture device. A scene may refer to a place and/or a location inwhich an image capture device is located while capturing visual content.A scene may include one or more portions of a place and/or a location atwhich the image capture device is directed during capture of the visualcontent. A scene may include one or more portions of a place and/or alocation that are within the field of view of the image capture deviceduring capture of the visual content. A scene may include static things(e.g., environment, non-moving objects) and/or dynamic things (e.g.,moving objects).

The scene may be depicted with one or more distortions based on captureof the visual content through a non-rectilinear lens. The capture of thevisual content through a non-rectilinear lens (e.g., fisheye lens) maycause one or more portions of the visual content to depict with scenewith one or more distortions. For example, capture of the visual contentthrough a non-rectilinear lens may cause a straight line within thescene to be depicted as a curved line within the visual content.

A distortion may refer to deviation from rectilinear projection. Inrectilinear projection, a straight line within a scene depicted withinthe visual content may appear as a straight line. A distortion may causedeviation of the visual content from rectilinear projection such that astraight line within a scene depicted within the visual content appearsas a curved line. For example, the distortion may include a radialdistortion, a barrel distortion, a pincushion distortion, and/or otherdistortions. For instance, the distortion may include a barreldistortion based on capture of the visual content through a fisheyelens.

FIG. 4 illustrates an example 400 image with barrel distortion. Thebarrel distortion may cause image magnification to decrease withdistance from the optical axis, simulating an image mapped around asphere/barrel. The barrel distortion may create curves within the image400. The curvature effect of the barrel distortion may increase withgreater distance from the center of the image 400. For example, thecenter option of the image 400 may exhibit little/no curvature due tobarrel distortion, while the corners of the image 400 may exhibit mostcurvature due to barrel distortion.

The distortion within the visual content may cause different portions ofthe visual content to be stored using different number of pixels. Forexample, referring to FIG. 4 , the center portion of the image 400 maybe stored using a greater number of pixels than the corner portions ofthe image 400. For instance, the center square of the image 400 may becaptured using greater surface area/grater number of pixels of the imagesensor than a corner square of the image 400, resulting in the centerbeing depicted with higher fidelity than the corner square.

The non-uniform warming component 104 may be configured to generaterectilinear visual content. The rectilinear visual content may begenerated for viewing and/or storage. The rectilinear visual content maybe generated by changing the visual content. The rectilinear visualcontent may be generated to replace the visual content and/or as adifferent version of the visual content.

The rectilinear visual content may be generated based on non-uniformwarping of the visual content. Warping of the visual content may referto digital manipulation of the visual content. Warping of the visualcontent may refer to distortion of thing(s) depicted within the visualcontent. Warping of the visual content may refer to change in how thevisual content depicts thing(s). For example, warping of the visualcontent may include stretching and/or squeezing of the visual content inone or more directions. Other types of warping of the visual content arecontemplated.

In some implementations, the non-uniform warping of the visual contentmay be performed based on the distortion within the visual content. Thenon-uniform warping of the visual content may be performed toeliminate/reduce the distortion within the visual content. In someimplementations, the non-uniform warping of the visual content may beperformed based on analysis of the visual content. For example, thevisual content may be analyzed to identify/characterize the distortionwithin the visual content, and the non-uniform warping of the visualcontent may be performed based identified/characterized distortion.

In some implementations, the non-uniform warping of the visual contentmay be performed based one or more optical elements through which thevisual content was captured. For example, the non-uniform warping of thevisual content may be performed based the type/characteristics ofnon-rectilinear lens through which the visual content was captured. Insome implementations, the information about the optical element(s)through which the visual content was captured may be obtained. Forexample, visual information defining the visual content may includeinformation about the optical element(s) through which the visualcontent was captured. Information about the optical element(s) throughwhich the visual content was captured may be obtained as metadata of theimage.

Non-uniform warping of the visual content may refer to varied warping ofthe visual content. Non-uniform warping of the visual content may referto warping of the visual content in which different types and/ordifferent amount of warping are performed at different portions of thevisual content. For example, non-uniform warping of the visual contentmay include different warping applied to different portions of thevisual content. For instance, include different strengths of warping maybe applied to different portions of the visual content. For example, theamount by which a portion of the visual content is stretched and/orsqueezed may change over the visual content. Different directions ofwarping may be applied to different portions of the visual content. Forexample, a portion of the visual content may be stretched and/orsqueezed in one direction while a different portion of the visualcontent may be stretched and/or squeezed in another direction.

The non-uniform warping of the visual content may include straighteningof curved line(s) within the visual content. That is, the non-uniform ofthe visual content may straighten straight lines within the scene thatare depicted as curved lines within the visual content (due to thedistortion within the visual content). Straightening of a curved linemay include complete straightening of the curved line so that a straightline within the scene is depicted as a straight line within therectilinear visual content. Straightening of a curved line may includepartial straightening of the curved line so that a straight line withinthe scene is depicted with less curvature within the rectilinear visualcontent than within the visual content.

FIG. 5 illustrates an example warping of the image shown in FIG. 4 . InFIG. 5 , the image 500 (rectilinear image) may be generated bynon-uniformly warping the image 400 shown in FIG. 4 . The depictionwithin the image 500 may have straighter lines than the depiction withinthe image 400. The non-uniform warping of the image 400 may produce theimage 500 that depicts things uniformly. For example, rather thanfeatures within the center of the image 400 being magnified and thecorners of the image 400 being greatly curved, the features within theimage 500 may be depicted with same/similar magnification and the amountof curvature may be reduced.

In some implementations, generation of the rectilinear visual contentmay include cropping of one or more outer portions of the visualcontent. For example, to generate the rectilinear visual content, theportions of the visual content outside a punchout 550 may be removed.Such generation of the rectilinear visual content may allow therectilinear visual content to fill a display without missinginformation.

Application of different warping to different portions of the visualcontent may result in the rectilinear visual content having non-uniformfidelity. The rectilinear visual content having non-uniform fidelity mayrefer to the fidelity of the rectilinear visual content varying over thevisual rectilinear content. The rectilinear visual content havingnon-uniform fidelity may refer to the fidelity of a portion of therectilinear visual content being different from the fidelity of adifferent portion of the rectilinear visual content. For example,referring to FIG. 5 , the fidelity of the image 500 may be higher in thecenter of the image 500 than in the corner of the image 500. Forexample, the fidelity of the image 500 may decrease with greaterdistance from the center of the image 500.

Fidelity of visual content may refer to a degree of exactness with whichthe visual content depicts one or more things (e.g., scene within thefield of view of the image capture device). Fidelity of visual contentmay refer to quality of depiction within the visual content (e.g., howclosely the depiction of a thing represents the thing). For example,fidelity of visual content may include number of resolution/pixels usedfor depiction of thing(s) in the visual content, sharpness/blurriness ofthe visual content, color accuracy of the visual content, textureaccuracy of the visual content, amount of details depicted (e.g.,highlight detail, shadow detail) in the visual content, amount of noisein the visual content, and/or other fidelity of the visual content.

For example, FIGS. 6A and 6B illustrate example portions 610, 620 of thewarped image shown in FIG. 5 . The portion 610 may include a centerportion of the image 500. The portion 620 may include an upper-rightportion of the image 500. The non-uniform warping performed to generatethe image 500 may result in the fidelity of the portion 510 beinghigher/better than the fidelity of the portion 620. For example, thecenter of the image 400 may have been squeezed to generate the portion610, and the portion 610 may include clear depiction of things/gooddetails of things. The upper-right portion of the image 400 may havebeen stretched to generate the portion 620, and the portion 620 mayinclude blurry depiction of things/lack details of things.

The non-uniform enhancement component 106 may be configured to generatehigher-fidelity visual content. The higher-fidelity visual content maybe generated for viewing and/or storage. The higher-fidelity visualcontent may be generated by changing the rectilinear visual content. Thehigher-fidelity visual content may be generated to replace therectilinear visual content, to replace the visual content, and/or as adifferent version of the visual content.

The higher-fidelity visual content may be generated based on non-uniformenhancement of the rectilinear visual content. Enhancement of the visualcontent may refer to modification of the visual content to improvementthe fidelity of the visual content. Enhancement of the visual contentmay refer increase in accuracy of how the visual content depicts things.For example, enhancement of the visual content may increase the numberof resolution/pixels used for depiction of thing(s) in the visualcontent, increase the sharpness of the visual content, increase thecolor accuracy of the visual content, increase the texture accuracy ofthe visual content, increase the amount of details depicted (e.g.,highlight detail, shadow detail) in the visual content, reduce theamount of noise in the visual content, and/or other increase otherfidelity of the visual content. Other types of enhancement of the visualcontent are contemplated.

In some implementations, the non-uniform enhancement of the rectilinearvisual content may be performed based on the non-uniform warping of thevisual content and/or other information. The non-uniform enhancement ofthe rectilinear visual content may be performed to restore/increasefidelity of the visual content lost during the non-uniform warping ofthe visual content. In some implementations, the non-uniform enhancementof the rectilinear visual content may be performed based analysis of therectilinear visual content. For example, the rectilinear visual contentmay be analyzed to identify/characterize the fidelity within differentportions of the rectilinear visual content, and the non-uniformenhancement of the rectilinear visual content may be performed based onthe identified/characterized fidelity within different portions of therectilinear visual content. As another example, the rectilinear visualcontent may be analyzed to identify/characterize the amount/type ofwarping performed to generate different portions of the rectilinearvisual content, and the non-uniform enhancement of the rectilinearvisual content may be performed based on the identified/characterizedamount/type of warping performed for different portions of therectilinear visual content.

In some implementations, the non-uniform enhancement of the rectilinearvisual content may be performed based on one or more optical elementsthrough which the visual content was captured. For example, thenon-uniform enhancement of the rectilinear visual content may beperformed based the type/characteristics of non-rectilinear lens throughwhich the visual content was captured. For instance, thetype/characteristics of non-rectilinear lens through which the visualcontent was captured may determine how both the non-uniform warping ofthe visual content and the non-uniform enhancement of the rectilinearvisual content are performed.

Non-uniform enhancement of the rectilinear visual content may refer tovaried enhancement of the rectilinear visual content. Non-uniformenhancement of the rectilinear visual content may refer to enhancementof the rectilinear visual content in which different types and/ordifferent amount of enhancement area performed at different portions ofthe rectilinear visual content. For example, the strength (intensity) ofenhancement applied may change over the rectilinear visual content. Forinstance, different strengths of enhancement may be applied to differentportions of the rectilinear visual content based on different strengthsof warping applied to the different portions of the visual content togenerate those portions of the rectilinear visual content. As anotherexample, the type of enhancement applied may change over the rectilinearvisual content. For instance, different types of enhancement may beapplied to different portions of the rectilinear visual content based ondifferent directions of warping applied to different portions of thevisual content to generate those portions of the rectilinear visualcontent.

For example, the extent of fidelity lost due to warping may bedetermined (e.g., mapped onto a heatmap), and the strength and the typeof enhancement applied may be adjusted to restore (completely restore,partially restore) the lost fidelity. For instance, the value of theheatmap may be used as a multiplier for the strength of enhancement thatis applied (e.g., using the value of the heatmap to apply gradient ofenhancement).

As another example, the variation in fidelity over the rectilinearvisual content may be determined (e.g., mapped onto a heatmap), and thestrength and the type of enhancement applied may be adjusted to equalizefidelity over different portions of the higher-fidelity visual content.For instance, different strength and/or type of enhancement applied sothat different portions of the higher-fidelity visual content have thesame fidelity or approximately the same fidelity (e.g., fidelity indifferent portions being within threshold fidelity value of each other).For example, the strength and the type of enhancement applied may beadjusted so that fidelity over the higher-fidelity visual contentmatches the fidelity in the center portion of the higher-fidelity visualcontent. For instance, the non-uniform enhancement of the rectilinearvisual content may be performed so that the fidelity in a corner/edgeportion is the same/approximately same as the fidelity in the centerportion.

In some implementations, different types of enhancement being applied atdifferent portions may include different portions being enhanceddifferently. For example, different types of enhancement may be appliedbased on one or more features of things depicted within the portionsand/or the different warping that was performed to generate theportions.

For example, the reduction in fidelity of the visual content may be moreapparent for certain types of things depicted within the visual contentand/or based on certain types of warping performed. For instance,warping in a direction that is not aligned with the direction of a thingmay have reduce the fidelity more than warping in the same direction.For example, an edge that is warping orthogonally to the direction ofthe edge may result in greater fidelity loss than warping along thedirection of the edge (e.g., a tree being warped in horizontal directionresults in greater fidelity loss than the tree being warped in verticaldirection). A direction in which a thing is depicted in the visualcontent may be determined, and the extent of alignment/misalignment ofthe warning to the direction of the thing's depictions may be used todetermine the strength and/or the type of enhancement applied.

The non-uniform enhancement of the rectilinear visual content mayincrease fidelity uniformity of the higher-fidelity visual content. Thatis, the fidelity of the higher-fidelity visual content may be moreuniform than the fidelity of the rectilinear visual content. Forexample, the corners of the rectilinear visual content may have lessfidelity than the center of the rectilinear visual content. Thenon-uniform enhancement of the rectilinear visual content may increasefidelity uniformity of the higher-fidelity visual content such that thedifference between the fidelity in the corners and center of thehigher-fidelity visual content is less than the difference between thefidelity in the corners and center of the rectilinear visual content.For instance, the non-uniform enhancement of the rectilinear visualcontent may increase fidelity of the corners so that the fidelity of thecorners are closer to/same as the fidelity at the center.

In some implementations, the non-uniform enhancement of the rectilinearvisual content may include application of non-uniform super-resolutionto the rectilinear visual content. Super-resolution may utilize machinelearning techniques to increase the fidelity (e.g., resolution, depicteddetails) of different portions. In some implementations, the non-uniformenhancement of the rectilinear visual content may include application ofnon-uniform sharpening to the rectilinear visual content. Sharpening mayresult in sharper/clearer appearance of depictions within differentportions. Other types of non-uniform enhancement of the rectilinearvisual content are contemplated.

FIG. 7A illustrates an example portion 710 of an image captured using anon-rectilinear lens. For example, the portion 710 may represent aportion of an image captured using fisheye lens. The portion 710 of thefisheye image may have been warped to reduce the amount of curvature inthe portion 710. The warping of the portion 710 may have non-uniformlyreduced the fidelity within the portion 710. For example, the fidelityon the left side of the portion 710 may be lower than the right side ofthe portion 710. The difference in fidelity may be due to greaterwarping having been performed on the left side of the portion 710 thanthe right side of the portion 10.

FIG. 7B illustrates an example enhancement of the image portion shown inFIG. 7A. The portion 710 of the image may be enhanced to generate anenhanced portion 720. Non-uniform enhancement may be applied to generatethe enhanced portion 720. For example, greater enhancement may beapplied to the left side of the portion 710 based on the left side ofthe portion 710 having lower fidelity, and less enhancement may beapplied to the right side of the portion 710 based on the right side ofthe portion 710 having higher fidelity. The change in strength ofenhancement applied may be gradual or immediate. For example, onestrength of enhancement may be applied to the left side of the portion710 while another (lower) strength of enhancement may be applied to theleft side of the portion 710. As another example, a gradient ofenhancement strength may be applied, with the strength increasingtowards the left.

The non-uniform enhancement of the visual content may result in theenhanced portion 720 having higher fidelity than the portion 710. Thenon-uniform enhancement of the visual content may result in the enhancedportion 720 having more uniform fidelity than the portion 710. Forexample, the left side of the enhanced portion 720 may depict palm treesand buildings with higher fidelity (e.g., is sharper, with more details)than the left side of the portion 710. The difference in fidelitybetween the left and rights side of the enhanced portion 720 may be lessthan the difference in fidelity between the left and rights side of theportion 710.

In some implementations, the higher-fidelity visual content may begenerated before and/or after encoding of the image by the image capturedevice. For example, the higher-fidelity visual content may be generatedto replace the original visual content of the image when encoding theimage. The higher-fidelity visual content may be generated to encode anadditional image with higher fidelity (e.g., encode the original imageand the higher-fidelity image).

Implementations of the disclosure may be made in hardware, firmware,software, or any suitable combination thereof. Aspects of the disclosuremay be implemented as instructions stored on a machine-readable medium,which may be read and executed by one or more processors. Amachine-readable medium may include any mechanism for storing ortransmitting information in a form readable by a machine (e.g., acomputing device). For example, a tangible (non-transitory)machine-readable storage medium may include read-only memory, randomaccess memory, magnetic disk storage media, optical storage media, flashmemory devices, and others, and a machine-readable transmission mediamay include forms of propagated signals, such as carrier waves, infraredsignals, digital signals, and others. Firmware, software, routines, orinstructions may be described herein in terms of specific exemplaryaspects and implementations of the disclosure, and performing certainactions.

In some implementations, some or all of the functionalities attributedherein to the system 10 may be provided by external resources notincluded in the system 10. External resources may include hosts/sourcesof information, computing, and/or processing and/or other providers ofinformation, computing, and/or processing outside of the system 10.

Although the processor 11 and the electronic storage 13 are shown to beconnected to the interface 12 in FIG. 1 , any communication medium maybe used to facilitate interaction between any components of the system10. One or more components of the system 10 may communicate with eachother through hard-wired communication, wireless communication, or both.For example, one or more components of the system 10 may communicatewith each other through a network. For example, the processor 11 maywirelessly communicate with the electronic storage 13. By way ofnon-limiting example, wireless communication may include one or more ofradio communication, Bluetooth communication, Wi-Fi communication,cellular communication, infrared communication, Li-Fi communication, orother wireless communication. Other types of communications arecontemplated by the present disclosure.

Although the processor 11 is shown in FIG. 1 as a single entity, this isfor illustrative purposes only. In some implementations, the processor11 may comprise a plurality of processing units. These processing unitsmay be physically located within the same device, or the processor 11may represent processing functionality of a plurality of devicesoperating in coordination. The processor 11 may be configured to executeone or more components by software; hardware; firmware; some combinationof software, hardware, and/or firmware; and/or other mechanisms forconfiguring processing capabilities on the processor 11.

It should be appreciated that although computer components areillustrated in FIG. 1 as being co-located within a single processingunit, in implementations in which processor 11 comprises multipleprocessing units, one or more of computer program components may belocated remotely from the other computer program components. Whilecomputer program components are described as performing or beingconfigured to perform operations, computer program components maycomprise instructions which may program processor 11 and/or system 10 toperform the operation.

While computer program components are described herein as beingimplemented via processor 11 through machine-readable instructions 100,this is merely for ease of reference and is not meant to be limiting. Insome implementations, one or more functions of computer programcomponents described herein may be implemented via hardware (e.g.,dedicated chip, field-programmable gate array) rather than software. Oneor more functions of computer program components described herein may besoftware-implemented, hardware-implemented, or software andhardware-implemented.

The description of the functionality provided by the different computerprogram components described herein is for illustrative purposes, and isnot intended to be limiting, as any of computer program components mayprovide more or less functionality than is described. For example, oneor more of computer program components may be eliminated, and some orall of its functionality may be provided by other computer programcomponents. As another example, processor 11 may be configured toexecute one or more additional computer program components that mayperform some or all of the functionality attributed to one or more ofcomputer program components described herein.

The electronic storage media of the electronic storage 13 may beprovided integrally (i.e., substantially non-removable) with one or morecomponents of the system 10 and/or as removable storage that isconnectable to one or more components of the system 10 via, for example,a port (e.g., a USB port, a Firewire port, etc.) or a drive (e.g., adisk drive, etc.). The electronic storage 13 may include one or more ofoptically readable storage media (e.g., optical disks, etc.),magnetically readable storage media (e.g., magnetic tape, magnetic harddrive, floppy drive, etc.), electrical charge-based storage media (e.g.,EPROM, EEPROM, RAM, etc.), solid-state storage media (e.g., flash drive,etc.), and/or other electronically readable storage media. Theelectronic storage 13 may be a separate component within the system 10,or the electronic storage 13 may be provided integrally with one or moreother components of the system 10 (e.g., the processor 11). Although theelectronic storage 13 is shown in FIG. 1 as a single entity, this is forillustrative purposes only. In some implementations, the electronicstorage 13 may comprise a plurality of storage units. These storageunits may be physically located within the same device, or theelectronic storage 13 may represent storage functionality of a pluralityof devices operating in coordination.

FIG. 2 illustrates method 200 for increasing image fidelity. Theoperations of method 200 presented below are intended to beillustrative. In some implementations, method 200 may be accomplishedwith one or more additional operations not described, and/or without oneor more of the operations discussed. In some implementations, two ormore of the operations may occur substantially simultaneously.

In some implementations, method 200 may be implemented in one or moreprocessing devices (e.g., a digital processor, an analog processor, adigital circuit designed to process information, a central processingunit, a graphics processing unit, a microcontroller, an analog circuitdesigned to process information, a state machine, and/or othermechanisms for electronically processing information). The one or moreprocessing devices may include one or more devices executing some or allof the operation of method 200 in response to instructions storedelectronically on one or more electronic storage media. The one or moreprocessing devices may include one or more devices configured throughhardware, firmware, and/or software to be specifically designed forexecution of one or more of the operations of method 200.

Referring to FIG. 2 and method 200, at operation 201, visual informationand/or other information may be obtained. The visual information maydefine visual content of an image. The visual content may depict a scenewith a distortion based on capture of the visual content through anon-rectilinear lens such that a straight line within the scene isdepicted as a curved line within the visual content. In someimplementations, operation 201 may be performed by a processor componentthe same as or similar to the visual information component 102 (Shown inFIG. 1 and described herein).

At operation 202, rectilinear visual content may be generated based onnon-uniform warping of the visual content. The non-uniform warping ofthe visual content may include straightening of the curved line withinthe visual content. The non-uniform warping of the visual content mayinclude different warping applied to different portions of the visualcontent such that the rectilinear visual content has non-uniformfidelity. A first portion of the rectilinear visual content may havefirst fidelity and a second portion of the rectilinear visual contentmay have second fidelity lower than the first fidelity. In someimplementations, operation 202 may be performed by a processor componentthe same as or similar to the non-uniform warming component 104 (Shownin FIG. 1 and described herein).

At operation 203, higher-fidelity visual content may be generated basedon non-uniform enhancement of the rectilinear visual content. Thenon-uniform enhancement of the rectilinear visual content may beperformed based on the non-uniform warping of the visual content and/orother information. The non-uniform enhancement of the rectilinear visualcontent may increase fidelity uniformity of the higher-fidelity visualcontent. The fidelity uniformity of the higher-fidelity visual contentmay be increased such that difference between the first fidelity of thefirst portion of the higher-fidelity visual content and the secondfidelity of the second portion of the higher-fidelity visual content isreduced. In some implementations, operation 203 may be performed by aprocessor component the same as or similar to the non-uniformenhancement component 106 (Shown in FIG. 1 and described herein).

Although the system(s) and/or method(s) of this disclosure have beendescribed in detail for the purpose of illustration based on what iscurrently considered to be the most practical and preferredimplementations, it is to be understood that such detail is solely forthat purpose and that the disclosure is not limited to the disclosedimplementations, but, on the contrary, is intended to covermodifications and equivalent arrangements that are within the spirit andscope of the appended claims. For example, it is to be understood thatthe present disclosure contemplates that, to the extent possible, one ormore features of any implementation can be combined with one or morefeatures of any other implementation.

What is claimed is:
 1. A system for increasing image fidelity, thesystem comprising: one or more physical processors configured bymachine-readable instructions to: obtain visual information, the visualinformation defining visual content of an image, the visual contentdepicting a scene with a distortion based on capture of the visualcontent through a non-rectilinear lens such that a straight line withinthe scene is depicted as a curved line within the visual content;generate rectilinear visual content based on non-uniform warping of thevisual content, the non-uniform warping of the visual content performedbased on a type or characteristics of the non-rectilinear lens throughwhich the visual content was captured, the non-uniform warping of thevisual content including stretching or squeezing of different portionsof the visual content to straighten the curved line within the visualcontent, stretching of the visual content resulting in greater loss offidelity of the visual content than squeezing of the visual content, thenon-uniform warping of the visual content including different warpingapplied to the different portions of the visual content such that therectilinear visual content has non-uniform fidelity from non-uniformloss of fidelity in the visual content, wherein a first portion of therectilinear visual content has first fidelity and a second portion ofthe rectilinear visual content has second fidelity lower than the firstfidelity; and generate higher-fidelity visual content based onnon-uniform enhancement of the rectilinear visual content, thenon-uniform enhancement of the rectilinear visual content performedbased on the non-uniform warping of the visual content that stretched orsqueezed the different portions of the visual content based on the typeor the characteristics of the non-rectilinear lens through which thevisual content was captured, the non-uniform enhancement of the visualcontent restoring non-uniform fidelity reduction of the visual contentfrom the non-uniform warping of the visual content, wherein thenon-uniform enhancement of the rectilinear visual content increasesfidelity uniformity of the higher-fidelity visual content such thatdifference between the first fidelity of the first portion of thehigher-fidelity visual content and the second fidelity of the secondportion of the higher-fidelity visual content is reduced.
 2. The systemof claim 1, wherein the distortion includes a barrel distortion and thenon-rectilinear lens includes a fisheye lens.
 3. The system of claim 2,wherein generation of the rectilinear visual content includes croppingof one or more outer portions of the visual content.
 4. The system ofclaim 1, wherein the non-uniform enhancement of the rectilinear visualcontent includes application of non-uniform super-resolution to therectilinear visual content.
 5. The system of claim 1, wherein thenon-uniform enhancement of the rectilinear visual content includesapplication of non-uniform sharpening to the rectilinear visual content.6. The system of claim 1, wherein the non-uniform warping of the visualcontent including the different warping applied to the differentportions of the visual content includes different strengths of warpingbeing applied to the different portions of the visual content.
 7. Thesystem of claim 6, wherein the non-uniform enhancement of therectilinear visual content being performed based on the non-uniformwarping of the visual content includes different strengths ofenhancement being applied to the different portions of the rectilinearvisual content based on the different strengths of warping applied tothe different portions of the visual content.
 8. The system of claim 1,wherein: a direction in which a thing is depicted in the visual contentis determined; and strength and/or type of enhancement applied in thenon-uniform enhancement of the rectilinear visual content is determinedbased on extent of alignment or misalignment between a direction inwhich thing depicted in the visual content is warped and the directionin which the thing is depicted in the visual content.
 9. The system ofclaim 1, wherein extent of fidelity lost due to the non-uniform warpingof the visual content is determined and mapped onto a heatmap, andvalues of the heatmap are used as a multiplier for strengths ofenhancement being applied to the different portions of the rectilinearvisual content in the non-uniform enhancement of the rectilinear visualcontent.
 10. A method for increasing image fidelity, the methodperformed by a computing system including one or more processors, themethod comprising: obtaining, by the computing system, visualinformation, the visual information defining visual content of an image,the visual content depicting a scene with a distortion based on captureof the visual content through a non-rectilinear lens such that astraight line within the scene is depicted as a curved line within thevisual content; generating, by the computing system, rectilinear visualcontent based on non-uniform warping of the visual content, thenon-uniform warping of the visual content performed based on a type orcharacteristics of the non-rectilinear lens through which the visualcontent was captured, the non-uniform warping of the visual contentincluding stretching or squeezing of different portions of the visualcontent to straighten the curved line within the visual content,stretching of the visual content resulting in greater loss of fidelityof the visual content than squeezing of the visual content, thenon-uniform warping of the visual content including different warpingapplied to the different portions of the visual content such that therectilinear visual content has non-uniform fidelity from non-uniformloss of fidelity in the visual content, wherein a first portion of therectilinear visual content has first fidelity and a second portion ofthe rectilinear visual content has second fidelity lower than the firstfidelity; and generating, by the computing system, higher-fidelityvisual content based on non-uniform enhancement of the rectilinearvisual content, the non-uniform enhancement of the rectilinear visualcontent performed based on the non-uniform warping of the visual contentthat stretched or squeezed the different portions of the visual contentbased on the type or the characteristics of the non-rectilinear lensthrough which the visual content was captured, the non-uniformenhancement of the visual content restoring non-uniform fidelityreduction of the visual content from the non-uniform warping of thevisual content, wherein the non-uniform enhancement of the rectilinearvisual content increases fidelity uniformity of the higher-fidelityvisual content such that difference between the first fidelity of thefirst portion of the higher-fidelity visual content and the secondfidelity of the second portion of the higher-fidelity visual content isreduced.
 11. The method of claim 10, wherein the distortion includes abarrel distortion and the non-rectilinear lens includes a fisheye lens.12. The method of claim 11, wherein generating the rectilinear visualcontent includes cropping of one or more outer portions of the visualcontent.
 13. The method of claim 10, wherein the non-uniform enhancementof the rectilinear visual content includes application of non-uniformsuper-resolution to the rectilinear visual content.
 14. The method ofclaim 10, wherein the non-uniform enhancement of the rectilinear visualcontent includes application of non-uniform sharpening to therectilinear visual content.
 15. The method of claim 10, wherein thenon-uniform warping of the visual content including the differentwarping applied to the different portions of the visual content includesdifferent strengths of warping being applied to the different portionsof the visual content.
 16. The method of claim 15, wherein thenon-uniform enhancement of the rectilinear visual content beingperformed based on the non-uniform warping of the visual contentincludes different strengths of enhancement being applied to thedifferent portions of the rectilinear visual content based on thedifferent strengths of warping applied to the different portions of thevisual content.
 17. The method of claim 10, wherein: a direction inwhich a thing is depicted in the visual content is determined; andstrength and/or type of enhancement applied in the non-uniformenhancement of the rectilinear visual content is determined based onextent of alignment or misalignment between a direction in which thingdepicted in the visual content is warped and the direction in which thething is depicted in the visual content.
 18. The method of claim 1,wherein extent of fidelity lost due to the non-uniform warping of thevisual content is determined and mapped onto a heatmap, and values ofthe heatmap are used as a multiplier for strengths of enhancement beingapplied to the different portions of the rectilinear visual content inthe non-uniform enhancement of the rectilinear visual content.
 19. Asystem for increasing image fidelity, the system comprising: one or morephysical processors configured by machine-readable instructions to:obtain visual information, the visual information defining visualcontent of an image, the visual content depicting a scene with adistortion based on capture of the visual content through anon-rectilinear lens such that a straight line within the scene isdepicted as a curved line within the visual content; generaterectilinear visual content based on non-uniform warping of the visualcontent, the non-uniform warping of the visual content performed basedon a type or characteristics of the non-rectilinear lens through whichthe visual content was captured, the non-uniform warping of the visualcontent including stretching or squeezing of different portions of thevisual content to straighten the curved line within the visual content,stretching of the visual content resulting in greater loss of fidelityof the visual content than squeezing of the visual content, thenon-uniform warping of the visual content including different warpingapplied to the different portions of the visual content such that therectilinear visual content has non-uniform fidelity from non-uniformloss of fidelity in the visual content, wherein a first portion of therectilinear visual content has first fidelity and a second portion ofthe rectilinear visual content has second fidelity lower than the firstfidelity; and generate higher-fidelity visual content based onnon-uniform enhancement of the rectilinear visual content, thenon-uniform enhancement of the rectilinear visual content performedbased on the non-uniform warping of the visual content that stretched orsqueezed the different portions of the visual content based on the typeor the characteristics of the non-rectilinear lens through which thevisual content was captured, the non-uniform enhancement of the visualcontent restoring non-uniform fidelity reduction of the visual contentfrom the non-uniform warping of the visual content, the non-uniformenhancement of the rectilinear visual content including application ofnon-uniform super-resolution to the rectilinear visual content, whereinthe non-uniform enhancement of the rectilinear visual content increasesfidelity uniformity of the higher-fidelity visual content such thatdifference between the first fidelity of the first portion of thehigher-fidelity visual content and the second fidelity of the secondportion of the higher-fidelity visual content is reduced.
 20. The systemof claim 19, wherein: a direction in which a thing is depicted in thevisual content is determined, and strength and/or type of enhancementapplied in the non-uniform enhancement of the rectilinear visual contentis determined based on extent of alignment or misalignment between adirection in which thing depicted in the visual content is warped andthe direction in which the thing is depicted in the visual content; orextent of fidelity lost due to the non-uniform warping of the visualcontent is determined and mapped onto a heatmap, and values of theheatmap are used as a multiplier for strengths of enhancement beingapplied to the different portions of the rectilinear visual content inthe non-uniform enhancement of the rectilinear visual content.